Microsurgery robots: addressing the needs of high-precision surgical interventions

Robots can help surgeons perform better quality operations, leading to reductions in the hospitalisation time of patients and in the impact of surgery on their postoperative quality of life

A robotic microsurgical forceps for transoral laser microsurgery

Purpose: In transoral laser microsurgery (TLM), the close curved cylindrical structure of the laryngeal region offers functional challenges to surgeons who operate on its malignancies with rigid, single degree-of-freedom (DOF) forceps. These challenges include surgeon hand tremors, poor reachability, poor tissue surface perception, and reduced ergonomy in design. The integrated robotic microsurgical forceps presented here is capable of addressing the above challenges through tele-operated tissue manipulation in TLM. Methods: The proposed device is designed in compliance with the spatial constraints in TLM. It incorporates a novel 2-DOF motorized microsurgical forceps end-effector, which is integrated with a commercial 6-DOF serial robotic manipulator. The integrated device is tele-operated through the haptic master interface, Omega.7. The device is augmented with a force sensor to measure tissue gripping force. The device is called RMF-2F, i.e. robotic microsurgical forceps with 2-DOF end-effector and force sensing. RMF-2F is evaluated through validation trials and pick-n-place experiments with subjects. Furthermore, the device is trialled with expert surgeons through preliminary tasks in a simulated surgical scenario. Results: RMF-2F shows a motion tracking error of less than 400 μm. User trials demonstrate the device’s accuracy in task completion and ease of manoeuvrability using the Omega.7 through improved trajectory following and execution times. The tissue gripping force shows better regulation with haptic feedback (1.624 N) than without haptic feedback (2.116 N). Surgeons positively evaluated the device with appreciation for improved access in the larynx and gripping force feedback. Conclusions: RMF-2F offers an ergonomic and intuitive interface for intraoperative tissue manipulation in TLM. The device performance, usability, and haptic feedback capability were positively evaluated by users as well as expert surgeons. RMF-2F introduces the benefits of robotic teleoperation including, (i) overcoming hand tremors and wrist excursions, (ii) improved reachability and accuracy, and (iii) tissue gripping feedback for safe tissue manipulation

Long Term Safety Area Tracking (LT-SAT) with online failure detection and recovery for robotic minimally invasive surgery.

Despite the benefits introduced by robotic systems in abdominal Minimally Invasive Surgery (MIS), major complications can still affect the outcome of the procedure, such as intra-operative bleeding. One of the causes is attributed to accidental damages to arteries or veins by the surgical tools, and some of the possible risk factors are related to the lack of sub-surface visibilty. Assistive tools guiding the surgical gestures to prevent these kind of injuries would represent a relevant step towards safer clinical procedures. However, it is still challenging to develop computer vision systems able to fulfill the main requirements: (i) long term robustness, (ii) adaptation to environment/object variation and (iii) real time processing. The purpose of this paper is to develop computer vision algorithms to robustly track soft tissue areas (Safety Area, SA), defined intra-operatively by the surgeon based on the real-time endoscopic images, or registered from a pre-operative surgical plan. We propose a framework to combine an optical flow algorithm with a tracking-by-detection approach in order to be robust against failures caused by: (i) partial occlusion, (ii) total occlusion, (iii) SA out of the field of view, (iv) deformation, (v) illumination changes, (vi) abrupt camera motion, (vii), blur and (viii) smoke. A Bayesian inference-based approach is used to detect the failure of the tracker, based on online context information. A Model Update Strategy (MUpS) is also proposed to improve the SA re-detection after failures, taking into account the changes of appearance of the SA model due to contact with instruments or image noise. The performance of the algorithm was assessed on two datasets, representing ex-vivo organs and in-vivo surgical scenarios. Results show that the proposed framework, enhanced with MUpS, is capable of maintain high tracking performance for extended periods of time ( ≃ 4 min - containing the aforementioned events) with high precision (0.7) and recall (0.8) values, and with a recovery time after a failure between 1 and 8 frames in the worst case

FetReg: Placental Vessel Segmentation and Registration in Fetoscopy Challenge Dataset

Fetoscopy laser photocoagulation is a widely used procedure for the treatment of Twin-to-Twin Transfusion Syndrome (TTTS), that occur in mono-chorionic multiple pregnancies due to placental vascular anastomoses. This procedure is particularly challenging due to limited field of view, poor manoeuvrability of the fetoscope, poor visibility due to fluid turbidity, variability in light source, and unusual position of the placenta. This may lead to increased procedural time and incomplete ablation, resulting in persistent TTTS. Computer-assisted intervention may help overcome these challenges by expanding the fetoscopic field of view through video mosaicking and providing better visualization of the vessel network. However, the research and development in this domain remain limited due to unavailability of high-quality data to encode the intra- and inter-procedure variability. Through the \textit{Fetoscopic Placental Vessel Segmentation and Registration (FetReg)} challenge, we present a large-scale multi-centre dataset for the development of generalized and robust semantic segmentation and video mosaicking algorithms for the fetal environment with a focus on creating drift-free mosaics from long duration fetoscopy videos. In this paper, we provide an overview of the FetReg dataset, challenge tasks, evaluation metrics and baseline methods for both segmentation and registration. Baseline methods results on the FetReg dataset shows that our dataset poses interesting challenges, offering large opportunity for the creation of novel methods and models through a community effort initiative guided by the FetReg challenge

modeling the laser ablation process

This chapter focuses on the problem of modeling the laser ablation process from a geometrical point of view. The objective is to create a model capable of describing the laser incision depth based on the knowledge of the laser parameters and inputs. The discussion starts with a statement of the problem, which is defined in terms of a supervised regression. Our approach is compared with existing heuristic models for the prediction of ablation depth

cognitive supervision for transoral laser microsurgery

This chapter introduces the problem of the automatic supervision of laser-induced effects during laser surgery. A top-down approach is used to tackle this problem: specific circumstances in which surgeons would value enhanced information regarding the effects of their laser actions on tissues are identified. The problem is grounded in the identification of variables of interest that are selected as target for the supervision. In the scope of this thesis, we explore the application of artificial cognitive approaches to monitor these variables in a surgical scenario

Comprehensiveness and programmatic vulnerability to stds/hiv/aids in primary care

This study aimed to identify programmatic vulnerability to STDs/HIV/AIDS in primary health centers (PHCs). This is a descrip - tive and quantitative study carried out in the city of São Paulo. An online survey was applied (FormSUS platform), involving administrators from 442 PHCs in the city, with responses received from 328 of them (74.2%), of which 53.6% were nurses. At - tention was raised in relation to program - matic vulnerability in the PHCs regarding certain items of infrastructure, prevention, treatment, prenatal care and integration among services on STDs/HIV/AIDS care. It was concluded that in order to reach comprehensiveness of actions for HIV/ AIDS in primary health care, it is necessary to consider programmatic vulnerability, in addition to more investment and reor - ganization of services in a dialogue with the stakeholders (users, multidisciplinary teams, and managers, among others)